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Abstract 



The theory of limits of dense graph sequences was initiated by Lovasz and 
Szegedy in [8]. We give a possible generalization of this theory to multigraphs. Our 
proofs are based on the correspondence between dense graph limits and countable, 
exchangeable arrays of random variables observed by Diaconis and Janson in [5]. 
The main ingredient in the construction of the limit object is Aldous' representation 
theorem for exchangeable arrays, see pQ. 
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1 Introduction 



In recent years a limiting theory has been developed for dense graph sequences (in dense 
graphs the number of edges is comparable with |^/(G)| 2 ). Roughly speaking, a sequence 
(G„)^ =1 of simple graphs converges if for any fixed testgraph F, the density of copies 
of F found in G n (called the homomorphism density) converges as n — > oo. It was 
shown in [8] that the limit object can be represented by a symmetric measurable function 
W : [0, l] 2 — > [0, 1]. Such functions are called graphons. 

In [8], Subsection 6.2 the authors briefly discuss the possible generalization of the 
theory to multigraphs (graphs with multiple and loop edges), pointing out technical 
issues which arise because the number of edges possibly connecting two vertices in a 
multigraph is not bounded, which leads to a lack of the compactness properties used in 
their proofs. They also show that the notion of graphons is not suitable for defining the 
limits of multigraphs if the testgraphs are also allowed to be multigraphs. 



In this paper we present a generalization of the theory of dense graph limits to multi- 
graphs. 

• In Section [2] we give a possible way to generalize the notion of the Mobius trans- 
form, homomorphism densities, graphons, gluing of /c-labeled graphs, reflection 
positivity and convergence of graph sequences to multigraphs. We state the main 
result of this paper in Theorem [TJ which is an analogue of Theorem 2.2 of [8] 
giving equivalent characterizations of the graph parameters arising as limits of ho- 
momorphism densities. Proposition [1] guarantees that our collection of observables 
determines the observed multigraph uniquely. In Proposition [2] we give a use- 
ful characterization of the precompact subsets of the space of limit objects called 
multigraphons, which are of the form W : [0, l] 2 x N — > [0, 1] . 

• Our methods are different from those used in [8]: In Section [3] we make a connec- 
tion between multigraph limits and the theory of infinite exchangeable arrays of 
random variables (based on [5] and [2]): we generate countable random arrays using 
multigraphs and multigraphons to show that we can interpret the homomorphism 
densities as probabilities on a special probability space. The multiplicativity of 
graph homomorphism densities corresponds to the dissociated property of random 
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arrays, convergence of multigraph sequences corresponds to convergence in distri- 
bution of random arrays. In [S] a parallel theory of consistent countable random 
graph models is described: we give a short dictionary of the corresponding concepts 
in the different terminologies. 

• In Section [3]we state and prove Theorem^ a representation theorem for exchange- 
able arrays. This theorem is stated but not proved in , and proofs of variants of 
Theorem [2] can be found in [2] and [6], but in our opinion the self-contained and 
streamlined treatment of the proof helps to understand why Szemeredi's lemma 
can be replaced by Aldous' representation theorem in the construction of multi- 
graphons. 

• In Section we prove Theorem [T] following the cyclic structure of the proof of 
Theorem 2.2 of [8]. In many cases, the connection with infinite exchangeable arrays 
makes the proofs more transparent, e.g. the proof of the reflection positivity of 
multigraphon homomorphism densities became simpler and Azuma's inequality is 
no longer needed for the proof of the fact that every multigraphon is the limit 
object of a convergent graph sequence. 

The methods of this paper can be applied to give a multigraph generalization of The- 
orem 3.2 of |9] relating isolate-indifferent graph parameters to random graphons. Also, 
Aldous' representation theorem can be useful in the description of the limit object of 
convergent sequences of weighted graphs. In [2] representation theorems of higher dimen- 
sional random exchangeable arrays are used to describe the limit objects of convergent 
hyper graph sequences. 

Representation theorems similar to ours can be found in the literature: 
The theory describing the limit objects of weighted graph sequences with uniformly 
bounded edgeweights is presented in [TU]. The results therein are highly similar to ours 
(e.g. the limit objects are of form W : [0, l] 2 x N — > M and a version of Aldous' rep- 
resentation theorem for exchangeable and dissociated arrays is proved using Szemeredi 
partitions), although some definitions are different (e.g. in their definition of the gluing 
of labeled multigraphs the adjacency matrices are summed whereas in our definition (see 
(I24p ) their maximum is considered, and their definition of homomorphism densities is 
related to the moment sequence of random variables, whereas ours is more related to 
the distribution function of the same random variables). The condition on the uniform 
boundedness of edgeweights in [10J (which is needed for certain compactness arguments) 
can be relaxed: in [12J it is shown that the limit of a convergent and uniformly L p - 
bounded sequence of R- valued graphons can itself be represented by a graphon if we only 
consider homomorphism densities of simple testgraphs in the definition of the convergence 
of graphons. 

The theory of multigraphons described in this paper fits into a more general framework 
(worked out in [TTJ using Szemeredi partitions) in which limits of complete graphs are 
studied where the edges are labeled by elements from a fixed compact topological space 
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S. In the special case when S is the one point compactification N U oo of the natural 
numbers the limit objects are basically equivalent with the ones studied in the present 
paper. The only difference is that for non-tight sequences the symbol oo appears with 
a nonzero probability in the limit object. In general the limit object is a measurable 
function from the unit square to the space of probability distributions on S. In Theorem 
2.9 and Corollary 3.5 of j2] one finds even more general representation theorems of similar 
flavor for infinite, exchangeable graphs in which edges are labeled by elements from a 
Borel space. 

It is apparent from the extensive list of related results above that the theory of 
multigraphons is already implicitly present in the literature, but in order to write the 
paper [13] about the time evolution of the edge reconnecting model we needed a reference 
in which Theorem [T] (giving equivalent characterizations of the multigraph parameters 
arising as limits of homomorphism densities) is explicitly stated and proved. 

Acknowledgement. Balazs Rath thanks Laszlo Lovasz and Laszlo Szakacs for intro- 
ducing him to the theory of dense graph limits (and raising the question of possible 
generalizations to multigraphs) and Balint Toth for turning his attention to the con- 
nection with exchangeability. Istvan Kolossvary thanks Domokos Szasz for introducing 
him to the theory of dense graph limits. We also thank the anonymous referees for their 
useful comments. 

This research was partially supported by the OTKA (Hungarian National Research 
Fund) grants K 60708 and CNK 77778 and Morgan Stanley Analytics Budapest. 

2 Definitions, statement of Theorem H 

In this section we generalize the definitions of [8] to multigraphs and state the general- 
ization of Theorem 2.2 of [8]. 

Let N := {1, 2, . . . }, N := {0, 1, 2, . . . } and [k] = {1, 2, . . . , k}. 

Denote by M. the set of undirected multigraphs (graphs with multiple and loop edges). 
Let F 6 M with |V(.F)| = k. The adjacency matrix of a labeling of the multigraph F 
with [k] is denoted by (A(i, j))*j =v where A(i,j) G N is the number of edges connecting 
the vertices labeled by i and j. A(i,j) = A(j, i) since the graph is undirected and A(i, i) 
is two times the number of loop edges at vertex i (thus A(i,i) is an even number). 

An unlabeled multigraph is the equivalence class of labeled multigraphs where two 
labeled graphs are equivalent if one can be obtained by relabeling the other. Thus Ai 
is the set of these equivalence classes of multigraphs, which are also called isomorphism 
types. 

We denote the set of adjacency matrices of multigraphs on k nodes by Ak, thus 
A k = {Ae N k xk : A T = A, Vi e [k] 2 | A(i,i)} . 
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Let M, N C N. 

A:={AeN? xN : Vi,j G N A(i,j) = A(j, i), Vi G N 2|A(i,i)} (1) 
i M ,N :={AgN^ xN : Vi,jeMnNA(i,i)=AO',»). VieMnN 2| A(z,z)} (2) 

Let / denote a multigraph parameter, that is / : M. — > R. If F e .M and A is the 
adjacency matrix of a labeling of F, then let /(A) := f(F). Conversely, if / : Ufeli ^fe ~~ ^ 
R is constant on isomorphism classes, then / defines a multigraph parameter. 

If A, A' G Ah then we say that A < A' if Vi, j G [A;] j) < j). 

If A G ^4fe denote by e(A) the number of edges: 

e(A) :=^A(i,j) 

Let denote the set of adjacency matrices of multigraphs with no multiple edges: 

S k = { A e A k : Vi^jA(i,i)G{0,l}, ViA(M)G{0,2}} 
We say that the multigraph parameter / is non- defective (or briefly /(oo) = 0) if 

VA; VAi,A 2 ,--- G A, lim e(A n ) = +oo lim f(A n ) = (3) 

n^oo n— >oo 

Definition 1. TTie Mobius transform o/ a function f : Ak — > R is defined by 

f{A)=Y,(-^) eiE) f(A + E). (4) 

E&£ k 

The inverse Mobius transform of g : Ak — > R is (formally) defined by 

oo 

ff _t (^)=E E l[A'>A,e(A') = n]. ff (A'). (5) 

n=0 A'e^ fe 

The infinite sum defining g~<(A) converges for some A G Ak if and only if it converges 
for all A G Ak- 

If /, g are multigraph parameters (i.e. their value is invariant under relabeling of 
vertices) then p, g^ are also multigraph parameters. 

Lemma 1. 

/: A k ^R, /(oo) = =}► (/ f ) _t = / (6) 
Proof. First note that if A, A" G A then 

> ^ + F] • (-l) e(E) = 1L4 = A"] (7) 
5 



N 

(/t)-t( A ) = jim £ £ ^l[A'>A )e (A')=n]-(-l)^)/(A' + J E;) 

n=0 A'eA -EG^fc 
AT 

i lim E E - A ' e ( A ' +E)=n]- (-l) e{E) f(A' + E) 

N 

= &E E E 1 ^"^ A+E ' e ( A ") = n ]-(- 1 ) e(i;) ^ ,/ ) i /^) 

n=0 A"e.4 fc BGffc 

□ 

Note that if / is a constant function then f* = 0, thus f(oo) = is essential for 
(/t)- f = /to hold. 

Suppose F,G E M, \V(F)\ = k, \V(G)\ = n and denote by A G A k and B G A n the 
adjacency matrices of F and G. 

Now we generalize the notion of graph homomorphism to multigraphs. Let </?:[&]—>■ 

1< [AB^] := 1 [Vi,j G [*] : A(i,j) < B(<p(i),<p(j))] (8) 

1= [A, B, ip] := 1 [Vz, j G [k] : A(i,j) = i%(i), </?(.?'))] ( 9 ) 

We call (p a graph homomorphism of F into G if and only if 1< [A, B, ip] = 1. This 
is a natural definition of an edge-preserving mapping for multigraphs, furthermore if F 
and G are simple graphs, this new definition coincides with the graph homomorphism 
definition of [8]. 

Definition 2. We define the homomorphism density of F into G by 

t< (F, G) := t< (A, B) := £ 1< [A, 5, (p] . (10) 

V3:[A;]->.[n] 

1/ we restrict the summation to infective maps ip : [k] <^-> [n] and normalize by the number 
of such maps we get the injective homomorphism density 

t° < (F,G):=t° < (A,B):=- — — — - £ U[A,B,<p] ■ (H) 

n n — 1 . . . (n — k + 1 ^— ' 

VFe a/so define the induced homomorphism density of F into G by 

t = (F,G):=t = (A,B):=^ £ 1 = [A, fl, , (12) 

p:[A;]-».[n] 

t(F,G):=tUA,B):= ' £ >-W,rf. (13) 

v ; v ; VJ:[A]^[n] 

> |V(GQ| in (HU) and dTJ), iaen t° (F, G) := t° = (F, G) := 0. 
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Even though we have used a particular labeled member of the isomorphism class F 
and G in Definition^ the quantities are well-defined for unlabeled graphs F and G, since 
relabeling F and G does not change the value. Thus every fixed multigraph G defines 
the multigraph parameters t< ( • , G), t%(- ,G), t= ( ■ , G), t=(- ,G). 

For fixed B and (p we have 1= [•, B, <p\' = 1< [•, B, if] and 1< [•, B, ipy = 1 = [•, B, ip\. 

The homomorphism densities inherit this property, thus we have 

t< (., G) = t= G) _t t= G) = t< (., G) f (14) 

t°< (., G) = £ (•, G)^ £ (•, G) = t°< G) f (15) 

Proposition 1. G G M. is uniquely determined given (t< (F,G)) F£M and \V(G)\. 

We prove this proposition in Section [3J 

Definition 3. A multigraphon is a measurable W : [0, 1] x [0, 1] x No -> [0, 1] function 
satisfying 

W(x,y,k) = W(y,x } k) } (16) 

oo 

J2W(x,y,k) = l, (17) 

jfc=0 

W(x, x, 2k + 1) = 0. (18) 

For every multigraphon W and multigraph F with adjacency matrix A G Ak we 
define 

/CO 
n W(x hXj ,l)dxidx 2 ... dx k (19) 

lJ,1 ] fc i<j<k l=A(i,j) 

t = (F,W):= [ TT W(x i ,x j ,A(i,j))dx 1 dx 2 ... dx k (20) 

^[O-l]* i<j<k 

The functions t<(-,W / ) and t = (-,W) are indeed multigraph parameters: their value is 
invariant under relabeling. It is easy to see that 

t<(-,W) = t = (-,W)- ] t = (-,W)=t<(-,W) ] (21) 

If G is a multigraph on n nodes with adjacency matrix B G A n , then let 

W G (x, y,k) = l [B( \nx\ , \ny] ) = k] (22) 

be the multigraphon generated by G. Although the function Wq depends on the choice 
of the labeling of G, the value of t< ( • , Wq) is invariant under relabeling. It is easy to 
see that 

t<(-,G) = t<(-,W G ), t = (-,G) = t = {-,W G ). (23) 
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Call a multigraph parameter / normalized, if /(Oi) = 1, where Oi is the graph with 
a single node and no edges. 

If / satisfies f(FiF 2 ) = f(Fi)f(F 2 ), where FiF 2 denotes the disjoint union of F% and 
F 2 , then / is multiplicative. 

If / is normalized and multiplicative then f(Ok) = 1 where 0^ denotes the graph with 
k nodes and no edges. 

The multigraph parameters £<(-,(?) and t< ( • , W) are normalized, multiplicative 
and non-defective. 

The multigraph parameters £= ( • ,G) and t= ( • , W 7 ) are neither normalized nor mul- 
tiplicative. 

A k-labeled multigraph (k G No) is a finite graph with at least k nodes, of which k 
are labeled by 1,2, ... ,k. For two A;-labeled graphs Fi and F 2 , define FiF 2 as the graph 
that one gets by taking their disjoint union, then identifying nodes with the same label, 
and the number of edges connecting two labeled nodes in F\F 2 is the maximum of the 
number of edges connecting them in Fx and F 2 . In the special case k — 0, F\F 2 is 
simply the disjoint union of the two graphs. Recall the defining equation ([!]) of the set 
of adjacency matrices of multigraphs indexed by a general subset of N. If we label the 
unlabeled vertices of F x and F 2 using disjoint subsets of N (thus V(Fi) D V(F 2 ) = [k]), 
and if A\ G Av(f 1 ) and A 2 G Av(f 2 ) are the adjacency matrices of F\ and F 2 then the 
adjacency matrix of F\F 2 is A\ V A 2 G Av(f 1 )uv{f 2 ) : 

{msx{A 1 {i,j),A 2 (i,j)} if i,j G [k] 
Mi,j) ifi,jey(F,)\[A:] (24) 

otherwise 

If Fi and F 2 are /c-labeled simple graphs then this definition of FiF 2 coincides with that 

Of0. 

For any multigraph parameter / and integer k > we define the connection matrix 
M(k, f) as an infinite matrix, whose rows and columns are indexed by (isomorphism 
classes of) /c-labeled multigraphs. Its elements are f(FiFj), where Fi corresponds to the 
row which Fi indexes and Fj to the respective column (so M(0, /) is a dyadic matrix if 
/ is multiplicative). 

Definition 4. A graph parameter f is reflection positive if the connection matrices 
M(k, f) are positive semidefinite for each k > 0. 

Definition 5. We say that a sequence {W n ) c £ =1 of multigraphons is convergent if f(F) = 
lim t< (F, W n ) exists for every multigraph F , moreover f is non- defective. 

A sequence {G n )^ =l of multigraphs is convergent (Wg b )^ =1 is convergent. 

Let T denote the set of graph parameters f arising as limits of multigraph sequences: 

feT 3 (GX =1 VF G M f(F) = lim t< (F, G n ) and /(oo) = (25) 
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If G n is the multigraph with one vertex and n loop edges then lim t< (F, G n ) = 1 for 

n— >oo ~ 

every F G Ai, but f(F) = 1 does not satisfy /(oo) = 0, so the sequence (G n )™ =1 is not 
convergent in this case. 

Theorem 1. For a multigraph parameter f the following are equivalent: 

(a) feT. 

(b) There exists a multigraphon W for which /( • ) = £<(•, W). 

(c) f is normalized, multiplicative, non- defective and reflection positive. 

(d) f is normalized, multiplicative, non-defective and f'>0. 
We prove this theorem in Section [5j 

We say that a sequence (W n )%Li of multigraphons is tight if 



rl rl °° 

lim max / W n (x, y, k) dx dy = (26) 

m^oo n J Q J Q f—' 
k=m 

rl 00 

lim max / W n (x, x, k) dx = (27) 

m— >oo n J„ ' J 

1' 1 r 1 



Proposition 2. 

(%) A convergent sequence of multigraphons is tight. 

(ii) A tight sequence of multigraphons contains a convergent subsequence. 
We prove this proposition in Subsection 15.51 

3 Vertex exchangeable arrays 

We will use 7r to denote a uniformly chosen random permutation of [n] and let 7r|ny be the 
restriction of the function 7r : [n] — >■ [n] to [k]. Thus 7r|ny is a uniformly chosen injective 
function from [A;] to [n]. 

Given a multigraph G with adjacency matrix B G A n we define a random array 
(Xq(i, j))™j =1 using the random permutation n by 

X° G ^j):=B(n(t),n(j)). (28) 

Thus (Xq(i, j))™j =1 is a random element of A n whose distribution only depends on the 
isomorphism type of G. 
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Now we introduce random infinite labeled multigraphs. Recalling (PQ) let A® denote 
the set of adjacency matrices (A(i,j))°°j =1 oi countable multigraphs: 

ii={A6N: xN : Vi,jA(i,j)=A(j,i),Vi 2\A(i,i)}. (29) 

We consider the probability space (An, F, P) where T is the coarsest sigma-algebra with 
respect to which A(i,j) is measurable for all i,j and P is a probability measure on 
the measurable space (A®, F). We are going to denote the infinite random array with 
distribution P by X = (X(i, j))°° =v We use the standard notation X ~ Y if X and Y 
are identically distributed (i.e., their distribution P is identical on (A®, J 7 )). 

Let £ (1) , £ (2) , . . . be i.i.d. uniformly chosen elements of the set [n]. Given a multi- 
graph G with adjacency matrix B 6 A n we define an infinite random array X G = 

X G (i,j):=B(Z(t),£(j)). (30) 

The distribution of X G is a probability measure P G on the measurable space (An, F). 
Clearly, the distribution of X G depends only on the isomorphism class of G. 

Now we are in a position to give new probabilistic meaning to the quantities defined 
in Definition [21 following [5]. If F is a multigraph with adjacency matrix A indexed by 
[k], then it is straightforward to check that 

P(\/i,j<k:A(i,j)<X° G (i,j)) (31) 

P(Vi,j<k:A(i,j) = X G (i,j)) (32) 

P(\/i,j<k:A(i,j)<X G (i,j)) (33) 

P(\/i,j<k:A(i,j)=X G (i,j)) (34) 

For (EU) and §M) we of course need V(F) < V(G). 

We can also define an infinite random array using a multigraphon W. 

Definition 6. Let U{ (i = 1,2,...) be independent random variables uniformly dis- 
tributed in [0,1]. Given (Ui)°^ l we define the array X w = (X w (i,j))°° =1 as follows: 
with probability W(Ui, Uj, k) let X w (i,j) = k. 

From this construction and the definition of W G in (f22|) it immediately follows that 

For every multigraphon W and multigraph F with adjacency matrix A we have 

t< (F, W) = P (Vi, j < k : A(i,j) < X w (i,j)) (35) 
t = (F, W) = P (Vi, j < k : A(i,j) = X w (i,j)) (36) 

Here we recall the well-known Kolmogorov extension theorem ([7], Section 1.4, The- 
orem 1.): 



t°< (F, G) = 
ti (F, G) = 
t< (F, G) = 
t= (F,G) = 
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Lemma 2. If {X n (i,j))^- =1 is the adjacency matrix of a random labeled graph G[ n ] for 
all n, moreover the consistency condition 

(X n (i,j))Z =1 -(X m (i,j))Z =1 (37) 

holds for all m < n (i.e, G\ m ] has the same distribution as the subgraph of G\ n \ spanned 
by the vertices labeled 1,2, ... ,m), then there exists a countable random graph (that is a 
probability measure on (An, J 7 )) with adjacency matrix X = {X(i,j))^- =l such that 

(X(i,j))l 3=1 -(X n (i,j))l 3=1 . (38) 

Moreover the distribution o/X is the unique probability distribution on (A®, J 7 ) for which 
([HS]) holds for all n. 



Proof of Proposition^ Assume given |V(G)| = n and t< (F, G) for all F £ Ai. We want 
to prove that this information uniquely determines the isomorphism type G. By (|14p we 
may assume given (t= (F, G)) FeM . By ( I3"l|) we know the distribution of (X G (i, j))f J=1 
for all k. By Lemma |2] we may assume given X^. 

Denote by B £ A n the adjacency matrix of a labeling of G. Define an equivalence 
relation ~ on [n] by 

i~j yk £ [n] B(i,k) = B(j,k). 

Let V denote the set of ~-equivalence classes. 

Define B~ £ A v (see (II])) by B^(I, J) = B(i,j) where /, J £ V and i e I, j e J. 
For J £ V let P~(7) := ^. 

The isomorphism type G can be recovered given B~, P~ and n. 
Now we show that P~ and P~ can be recovered given Xq. 
Define a (random) equivalence relation = on N by 

i9ij ykeN X G (i,k)=X G (j,k). 

Let V denote the set of =-equivalence classes. 

Define B^ £ Ay by B^(I, J) = B(i,j) where J, J £ V and i e I, j e J. 
Recalling fl30|) it is easy to see that 

V 



P(i = j ^ = l and P(|V| 



since almost surely every element of [n] will appear as the value of £ (i) for some % £ N. If 
we define J := {% £ N : £ {%) £ J}, i.e. we label the elements of V using the corresponding 
elements of V then we have P~ (/, J) = B^ (I, J) for all /, J £ V by this definition and 



P P K (J) 



1 W \ 
lim -Vl[i £/] 

i=l / 



by the law of large numbers. □ 
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Definition 7. A random array X = (X(i, j))°° =1 vertex exchangeable if 

W),T0')))5=i~(^(i,i))S =1 (39) 
/or all finitely supported permutations r : N — >■ N. 

We make the assumption of finite support only because working with all permutations 
introduces the additional technicalities of working with an uncountable group; however, 
with the right conventions these are routinely surmountable, and the resulting theory is 
easily seen to be equivalent. In fact it directly follows from the above definition and the 
uniqueness assertion of Kolmogorov's extension theorem (Lemma EJ) that ( 139)) holds for 
any explicitly described permutation r : N — > N with an infinite support. 

The fact that X G is vertex exchangeable easily follows from (£ (i))^ ~ (£ {T(i)))^l v 
Similarly, {U i )^L 1 ~ (U T ^)j implies that also satisfies ([59]) . 

By the uniqueness part of Lemma El the property (1591) is equivalent to 

P (Vz, j < n : X(z,j) = A(z,j)) = P (Vz, j < n : X(r(z), r(j)) = A(i,j)) (40) 

for all n G N, A G A n and r such that n' > n ==>- t(ti') = n'. 

Vertex exchangeability has several different names: in [1] X is called weakly exchange- 
able, in [5] the term jointly exchangeable is used, we call X vertex exchangeable because 
the distribution of a countable random graph with adjacency matrix X is invariant under 
any relabeling of the vertices. In Section 2.4 of [H] the distribution of a vertex exchange- 
able countable random graph is referred to as consistent and invariant. 

We extend (X° G (i, j)) ? j=1 defined by (El into X^ = (X° (z, j))°° =1 by defining X° G (i, j) = 
if z > n or j > n. Note that the extended X G satisfies (139 j) for permutations r : N — >■ N 
for which r(n') = n' if ri' > ti. 

Definition 8. Ca// an infinite array X = (X(z, i))°° =1 dissociated if for alln: (X(i,j))™- =1 
is independent of (X (i , j))™- n+1 for each m > n. 

It is easy to see that X G and are dissociated. We have taken the terminology 
dissociated over from [I], in [9] it is referred to as the local property of the distribution 
of the random graph: the distribution of subgraphs spanned by disjoint vertex sets are 
independent. 

3.1 Convergence of random arrays 

We say that a sequence of infinite arrays (X n (i,j))°°j =1 converges in distribution if 

VfcVAGA ]imP(yi,j<k:A(i,j)=X n (i,j))=g(A), (41) 

n— >oo 

Vk J2 9(A) = 1 (42) 
AeAk 



12 



for some g : Ufcli 

Alternatively we might say that (X n (i,j))°° =1 converges in distribution if and only if 

=1 converges in distribution to some random element of Ak for all k. 
By Lemma |2] there exists a random infinite array X = (X(i, j))°° =1 such that for all 
k and A 6 „4 fc 

P (Vz, j < k : A(z, j) = X n (i,j)) ™ P (Vz,j < k : A(z, j) = X(i,j)) (43) 

In this case we say that X n — — >■ X. If X n is exchangeable for all n, then X is also 
exchangeable. If X ra is dissociated for all n, then X is also dissociated. 

Lemma 3. For any multigraph sequence (G n )^ =1 and any multigraph parameter f it is 
equivalent that 

(a) (G n )^ =1 converges according to Definition^ and 

VF e M lim t< (F, G n ) — f(F). (44) 

(b) The sequence of infinite random arrays (X G converges in distribution and 

\/kVAeA k limP(Vi,j<k:A(i,j)<X Gn (i,j)) = f(A). (45) 

Proof. 

(Ej) (jb]): If lim n _ >00 t<(-,G' n ) = /(•) then by ® and (ED we get 

hmt = (-,G n ) = / t (-)- (46) 

n— yoo 

By /(oo) = (which is assumed in Definition |5]) we obtain 

V f\A) = (/t)- f (o fc ) i/(o») = iim *<(()*, eg = 1. 

Using ([34]) and fll| we get that X n := X Gn and g := f ] satisfy flU]) and (g2]), thus 
(X G )^ =1 converges in distribution. f l4"5]) follows from fl33|) and f l44"|) . 

Ob]) (nj): lim t< (F, G n ) = f(F) follows from (1531 and 

Let X Gn — X where P (Vz, j < k : A(i,j) < X(i,j)) = f(A). In order to prove 
/(oo) = let k e N and A 1 , A 2 ,-- - e A k such that e(A n ) -)> +oo. Now (X(z, j'))i,i=i is a 
random element of ^4^ thus the random variable e f(^(*>i))*j = ij is almost surely finite. 
It is easy to see that 

{Vz, j < k : A n (z,j) < X(i,j)} C |e(A n ) < e ((X(z, j))- j=1 ) } ■ 

Since the probability of the r.h.s. goes to as n — > oo, we obtain that / is non- 
defective. □ 
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Now we prove 

\V(G n )\^oo =► (x°, b -^X X Gn ^x) (47) 

By d32D, dMD and (j4T]) we only need to show that 

\V(G n )\->oo VF G M lim \t= (F, G n ) — t= (F, G n ) 1 = 0. (48) 

We show that if V(F) = fc and V(G) = n then 

|t = (F,G)-e(F,G)| <i(*)- 

We might assume k < n. Recalling the formulae ( 128]) and (130]) one can see that 
(Xg(i, j))^j =1 has the same distribution as pQ?(«,j))^- =1 under the condition 

i{e(i),...,e(*)}i = *. 

For any two events ^4 and F in any probability space 

\P(A) -P (A\ B)\ < 1 -P(B). (49) 
Using this inequality we get the desired 

|t= (F, G) - £ (F, G)| < P (1) , • • • , £ (*)}| <k) = 

p( U e(o=e(7)) < £ p(e(o = ec7)) = ^(*). 

\i<j<k J i<j<k ^ ' 

4 A representation theorem for vertex exchangeable 
arrays 

In this chapter we consider vertex exchangeable random elements of .An- The proofs 
work without any change for real-valued, symmetric, vertex exchangeable arrays, which 
correspond to adjacency matrices of undirected, infinite, vertex exchangeable weighted 
graphs. 

Theorem 2. Let a, {Uj) x<i , (A,i)i<j< ■ be i-i-d. random variables distributed uniformly 
in [0,1]. 

(i) Given a vertex exchangeable array X (that is: a vertex exchangeable random element 
of A^), there exists a measurable function f : [0, l] 4 — > Nq such that 

f(a, m, u 2 , b) = f(a, u 2 , «i, b) 
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and if we define the random array X by 

:= f{a, Ui, Uj, /3 mill (ij),max(i,i)) ( 50 ) 

then we have X ~ X. 

(ii) Moreover, if X is also dissociated then there exists a measurable function g : 
[0, l] 3 — > No such that g(u±, U2, b) = g{u2, u±, b) and 

( X (hj))%=l ~ {9(Ui, f/j,/3min(i,j),ma x (ij)))^ =1 • (51) 

Our aim is to give an accessible and self-contained proof. Proofs of different versions 
of this theorem can be found in the literature: 

In Theorem 1.4 of pQ a proof of the analogue of is given for row and column 
exchangeable (RCE) arrays (different permutations can be applied to the rows and 
columns). The variant of we prove (where X is not RCE, only vertex exchange- 
able) is only stated in Theorem 5.1 of PQ. Our proof of §j§ follows the structure of the 
proof of Theorem 1.4 of [1J but our proofs of Lemmas [TUJ [TT] and [T2] use methods from 

0- 

(Jn]) is only stated and proved for RCE arrays in [T], but the proof works in the vertex 
exchangeable well. The proof of a more general version of Theorem [2] is Chapter 

7 of [6]. Variants of §j§ and (Jn|) for random infinite exchangeable arrays corresponding to 
simple graphs are proved in Theorems 3.1 and 3.2 in [9]. 



4.1 Preliminaries 

In this subsection we state some less known facts of probability theory needed for the 
proof of Theorem [2J 

Assume given a probability space (Q, J 7 , P) and sub-a-algebra Q C J 7 . We denote the 
set of ^-measurable functions by mQ. Let Y G L 1 (Q, J 7 , P) denote a real-valued random 
variable on Q with finite expectation. The definition and basic properties of E (Y \ Q), 
the conditional expectation of Y with respect to Q are given in Chapter 9 of |15j . The 
defining property of E (Y \ Q) is 

Y' E mg and VZ G L°°(fi, Q) E (Y'Z) = E (YZ) P (Y' = E (Y \ Q)) = 1 

(52) 

We are going to use Steiner's theorem for conditional expectations: 

Zemg =^ E((Y-Z) 2 ) =E((F-E(F|^)) 2 ) +B((B(Y\g) - Z) 2 ) (53) 

Let (J r v ) veV be a finite or countably infinite family of sub- a- algebras of T . We say 
that (Fv) ve y are conditionally independent given Q if for all n G N, Vi, . . . ,v n G V, all 
i G [n], Yi G L°°(Q, F Vi ) we have 

tn \ n 

Hy g)=l[Eori\g) (54) 
i=l / i=l 
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Lemma 4. If C J s 2 C ... and T v = crdJ^Li^ 7 ™) f or a ^ v E V, then (J z v ) v&v are 
conditionally independent given Q if and only if {J Z y) v&v are conditionally independent 
given Q for all n G N. 

The proof is a standard exercise in measure theory. 

Two measurable spaces are Borel-isomorphic if there exists a bijection $ between 
them such that $ and $ _1 are measurable. A Borel space (S, B) is a measurable space 
which is Borel-isomorphic to some Borel subset of the real line. 

If Y : Q — > S is a random variable taking values in the Borel space (S, B) then the 
cr-algebra generated by Y is a(Y) := {Y- 1 {B) : B G B}. By 3.13 of [E]: 

Z G ma(Y) 3 / G m£ : Z = f(Y) (55) 

Let (KO-ugy be a finite or countably infinite family of random variables taking values 
in the Borel spaces Y v G S v . We say that (Y v ) veV are conditionally independent given Q 
if (a(Y v )) veV are conditionally independent given Q. If Q = a(Z) where Z is a random 
variable taking its values in the Borel space Sz then we say that (Y v ) v&v are conditionally 
independent given Z. 

Lemma 5. Let X , Y be random variables taking values in the Borel spaces Sx, Sy- Let 
Q l C Q 2 C . . . and = a (IJ^Li ^ n )- anc ^ ^ are conditionally independent given Q if 
and only if for allneN, Z G L°°(fi, G n ), f E L°°(Sx), g G L°°(5 y ) we have 

E (/(X)y(y)Z) = E (E (/(X) | Q) g{Y)Z) (56) 

The proof easily follows from the definitions of generated cr-algebra, conditional ex- 
pectation and conditional independence. 

If V = {vi, v 2, . . . } is a finite or countably infinite set then (Nq\ £>) is a Borel space 
where B is the cr-algebra generated by the finite cylinder sets of Nq. A sequence (Y v ) veV 
of No-valued random variables may be regarded as a single r.v. Y taking values in the 
Borel space Nq . In this case 

a(Y) = a (n a(Y Vl , . . . ,Y Vn )\ (57) 

Lemma 6. Let X , Y and Z be random variables taking values in the Borel spaces Sx, 
Sy, Sz- X and Y are conditionally independent given Z if and only if 

E(f(X)\Y,Z) = E(f(X)\Z) (58) 

for each f G L°°(Sx)- 

This is Theorem 1.45 in |Q. 

Call a family of random variables (Y v ) veV (taking values in the Borel space S) condi- 
tionally identically distributed given Q if E (f(Y v ) \ Q) = E (f(Y w ) | Q) for each v,w G V 
and / G L°°(S). When Q = a{Z) this is equivalent to (Y v , Z) ~ (Y w , Z) for all v, w G V. 
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Lemma 7 (Identification Lemma). Let Y = (Y v ) veV , Y* = (Y*) veV and Z be such that 

1. {Y v : v G V} are conditionally independent given Z , 

2. {Y* : v G V} are conditionally independent given Z , 

3. for each v G V , Y v and Y* are conditionally indentically distributed given Z . 
Then (Z, Y) ~ (Z, Y*) 

The proof of this statement is an easy exercise. 

Let a denote a random variable uniformly distributed on [0, 1], or a ~ U[0, 1]. Con- 
structing r.v.'s with prescribed distributions using a is called coding. 

Lemma 8 (Coding Lemma). 

(i) Let Y be a random variable taking values in the Borel space Sy. Then there exists 
a measurable function f : [0, 1] — > Sy such that Y ~ f(a) 

(ii) Suppose further that Z is a random variable taking values in Sz, and suppose that 
a is independent of Z . Then there exists a measurable function 

g:S z x [0, 1] -)■ S Y 
such that (Z,Y) ~ (Z, g(Z, a)). 
(Hi) Suppose further that X\ and X 2 are random variables taking values in Sx, 

(Z,X 1 ,X 2 ,Y)~(Z,X 2 ,X 1 ,Y) 
and a is independent of (Z, X ± , X 2 ). Then there exists a measurable function 

h: S z x S x x S x x [0, 1] ->■ S Y 
such that h(z,Xi,x 2 ,a) = h(z,x 2 ,x 1 ,a) and 

(Z, X U X 2 , Y) ~ (Z, X,, X 2 , h(Z, X u X 2 , a)) 

Proof. 

(i) First suppose Sy = K- Let F(y) = P (Y <y) denote the right-continuous distribu- 
tion function of Y . Let 

/(a) := F~\a) := mm{y : F(y) > a} 

Then Y ~ /(a)- The extension to the Borel space case is an immediate consequence 
of the definition of Borel space. 
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(ii) Again, first suppose Sy = R- Let F(y\z) be the conditional distribution function 
of Y given Z. For each z let g(z, a) := F~ 1 (a\z) be the inverse function. With this 
definition g has the property (Z,Y) ~ (Z, g(Z,a)). Again, the extension to the 
case when S is a Borel space is straightforward. 

(iii) Suppose Sy = R- Let F(y\z,Xx,x 2 ) be the conditional distribution function of Y 
given (Z, X lt A 2 ). From (Z, Ai, A 2 , F) ~ (Z, A 2 , X u F) it follows that F(y\z, x 1} x 2 ) = 
F(y\z,x 2 ,x 1 ). 

h(z,xi,x 2 ,a) := F~ 1 (a\z,Xi,x 2 ) has the desired properties. The extension to the 
case when S is a Borel space is straightforward. 

□ 

Lemma 9. Let Y E L 2 (Q, F, P) and F x C J" 2 C . . . , J 7 = a flX=i ^.), Si 2 & 2 

E (y | JF n ) — > Y almost surely and in L 2 (59) 

E (Y | Q n ) ->• E (y | 0) a/mosi stzrefy and zn L 2 (60) 

The L 2 convergence results easily follow from standard Hilbert space arguments and 
f )53|) . The a.s. convergence results follow from Levy's 'Upward' and 'Downward' theorems 
(Theorems 14.2 and 14.4 in [15]). 



4.2 Proof of Theorem H 



For the proof, let M := {—1, —2, . . . }. To simplify our notation we denote X^j := X(i,j). 
It is easy to see (e.g. by Lemma |2]) that the random array (X i j) i j €N has an exchangeable 
extension {X id ) ijmuW 

In this section, M and N will always denote finite sequences of integers. 

If M = (i\,i 2 , . . . , i m ) and N = (ji, j 2 , . . . , j n ) are sequences of integers and (X i} . 
is a random array then An,m denotes the random array 



X 



Xi 2 ,jl Xi 2 j 2 ... X; 



N,M 



12, jn 



\ 



\ -^imjl Xi mi j 2 ■ ■ ■ Aj mJn J 

We define the concatenation of the sequences M and N by 

MN = (i h . . .,i m ,ji, ■ ■ -Jn)- 



Lemma 10. For any vertex exchangeable array (X i j) i j eNuM the -valued random vari- 
ables (A n M ) neN are conditionally independent given A m ,m- 
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Proof. By Lemma H] and (j57p we only need to show that for all M C M and n G N the 
N^-valued random variables (Xj iM ) ie [ n ] are conditionally independent given X MiM . 

By induction we only need to prove that for all M C M, i 6 N, N C I such that 
i ^ N the random variables X^m and X^ M are conditionally independent given Xm,m- 

By Lemma [5] and fl55l) we only need to show that for all finite M' C M and all 
/ G L°°(N^), g G L°°(A$ M ) and h G L°°(Amm') ( see ©) we have 

E (f(X lM )g(X m )h(X M/M ,)) = E (E (f(X iM ) \ X MM ) g(X^ M )h(X^ M >)) (61) 

We might assume without loss of generality that M = M U M' = M'. Thus we have to 
show 

E (f(X ijM )g(X^ M )h(X MtM )) = E (E (/(X i(M ) | X m ,m) #(^n,m)M^m,m)) (62) 



Now let M C M be such that 



M 



N 



and M Pi M = 0. We apply a permutation r 

that swaps the elements of N with those of M. Using exchangeability and the fact that 
g(X^ M )h(X u ,u) is o (X M>M )-measurable we get 

E (f (X iM )g(X^ M )h(X M M)) = E [f(X itM )g(Xy liM )h(Xu,M)) = 

E (E (f(X iiU ) | X m ,m) #(^m,m)M^m,m)) (63) 

Before applying the permutation r again we show that the random variable E (/(X^m) | X& 
is invariant under r. Let M := M \ M. Now we prove 

E (/(Xj ;M ) | X MjM ) = E (/(X ijM ) | Xjjjjfo) (64) 

^"(Xj^fyj) C cr(X MjM ), thus by the repeated application of f[5"3"j) we only need to show 

E (E (/(X iiM ) | X MjM ) 2 ) = E ^E (/ (X i>M ) | Xf^) 2 ^ (65) 

in order to prove (164)) . Both M and M are countably infinite sets and M n M = 0, so 
there is a bijection between M and M which fixes M. Thus by exchangeability we have 
(Xwi,m,X,m) ~ (^m,m> ^Q,m) > which implies E (/(X i)M ) | X M>M ) ~ E (f(X i; u) \ ^m,m) 
from which (j64p and f)65p follow. Thus 

E (E (f(Xi t u) | X m ,m) 9(X^ M )h(XM,M)) = 

E (E (/(X, M ) I X m ) g(X UM )h(X MM )) (66) 

Now we apply the permutation r again. Using exchangeability we get 

E (e (f{X i)U ) | Xj^m) g(X^ M )h(X M ,M)) = 

E (E (/(X i)M ) | g(X^ M )h(X MM )) . (67) 

putting together (155]) . (IMjl , (jBEj) and (IB7j) we get (152]) . □ 
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Lemma 11. (Xj ,j) x<i< j are conditionally independent given Xm,mn- 

Proof. Let n G N and f i:j G L°°(N ) for all 1 < i < j < n. By (JHU) we need to show that 



Vl<i<i<n / l<«<j<n 



(68) 



In fact if we show that for all N, N C N, N D N = 0, / G L°°(yt N|N ), g G L°°(^,nn) 
we have 

E (/(X NN )(yf(Xj^ N] ^) | X M;MN ) = E (/(X NjN ) | X MjMN ) E (<7(Xjj iN jj) | X M)MN ) (69) 

then we are done: in order to prove (1681) using (1691) we first remove the terms correspond- 
ing to the diagonal elements. By repeatedly applying (IBUj) with the choice N = {i} and 
N = [n] \ i for all the elements 1 < i < n we get 



e( n m x *j) 

\l<«<j<n 



Xr 



13 E {fi,i{Xi.i) | Xr 



e( n 

\l<i<j<n 



X^ 



(70) 



Then we can factorize the product corresponding to the non-diagonal part by applying 
( 169]) repeatedly with the choice N = {i,j}, N = [n] \ {i,j} and /(Xn,n) := fi,j(X it j) for 
all 1 < % < j < n. 

By Lemma [5] in order to prove (|69|) we only need to show that for all finite N' C N, 

M C M, and h G L°°(Au,mn') we nave 

E (f(X NjN )g(X^ ^)h(X MjMN >)) = E (E (/(X N>N ) | X m ,mn) 5 , (X^ iN ^)/i(X MiMN ')) (71) 

NnN' and NnN' need not be empty. By increasing the support of / or g we might 
assume that N' = N U N with retaining the property N fl N = 0. Thus we need to show 

E (/(X NiN )5(X s ,nn)M^m,mnn)) = E (E (/(X NiN ) | X m ,mn) #(^n,nn)M^m,mnn)) ( 72 ) 



Let M C M be such that M fl M = and 



M 



N 



. Denote by r the permutation 



that swaps the elements of N with those of M. Using exchangeability and the fact that 
#(^m,nm)M^m,mnm) is a (X M ,MN)-measurable we get 

E (f(X N:N )g(X^ ^)h(X MMN ^)) = E (/(^n,n)p(^m ) nm)^(^m,mnm)) = 

E (E (/(X N)N ) I X MjMN ) g(X^ N ^)h(X M MN ^)) (73) 



20 



Now both M and M := M\M are countably infinite sets, so similarly to (jMJ) we have 

E (/(-Xn,n) I ^m,mn) = E (/(Xn,n) | ^m,mn) 

Thus by applying r again and using exchangeability we get (172)1 similarly to the final 
steps of the proof of Lemma [TOj □ 

Lemma 12. J/NCN then Xn,n o,nd Xm,mn o^e conditionally independent given Jm,mn- 

Proof. By Lemma H] and Lemma [5] we only have to show that for all M C M, NCN, 
N n N = 0, / e L°°(.An,n), 9 e £~(Ai,mnn)> h e L°°(Ai,mn) we have 

E (/(Xn,n)#(^m,mnn)M^m,mn)) = E (E (/(X N;N ) | X m ,mn) #(^m,mnn)M^m,mn)) (74) 



Choose M C M such that 



M 



N 



and M fl M = 0. By applying a permu- 



tation that swaps the elements of N and M, using exchangeability and the fact that 
3(^m,mmn)M^m,mn) is a (X MiMN )-measurable we get 

E (f(X NjN )g(X MM ^ N )h(X M ,M^)) — E (/(^n,n)5(^m,mmn)^(^m,mn)) = 

E (E (f(X NjN ) | X MjMN ) (yf(X M)M] y IN )^(X MjMN )) (75) 

Let M = M \ M. Similarly to QB3J) we get 

E (/(Xn,n) I ^m,mn) = E (/(Xn,n) I -^m,mn) > 
from which (|74j) follows in a similar fashion as in the previous two lemmas. □ 



Proof of Theorem^ Our proof follows [I]. We consider the extended process X MNjMN . 
Let a, (Ui) ieN , (A,i)i<i<j ^ e j°i n tly i-i-d. U[0, 1] random variables independent from 

^MN,MN- 

Pick io,jo G N, io < jo- By Lemma [8] (Jm]) there exists a 

/i : Ai,m x Ng 1 x Ng 1 x [0, 1] ->• No 
such that Xi, x 2 , 6) = x 2 , x\, b) and putting 

^iojo = ^(-^M,Mj ^io,Mi -^Jo»Mj Aojo) 

we have 

(^M,M, -Xj ,M, -Xjo,Mj -^i*o Jo) ~ (^M,M)^i ,M)-^Jo,M)-i 5 QoJo)- (76) 

For i / j G N we define 

-^£J := ^(-^M,M) ^Q,M; -Xj,M! /5min(iJ),max(iJ) ) (77) 
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By Lemma [S] dE} there exists a h such that putting 

X 



(Xm,M> ^Qo,M) -^i* ,i ) ~ (^M,Mj ^"io,M; -^io.io) 
:= ^(-^M,Mj Xi t M, 

Having defined X*^ for alH, j G N we use Lemma [7] to prove 



we have 

For i G N, we define 



(Xm,MN, ^N,n) ~ (Xm,MN, X^ n) 



(78) 
(79) 



(X, 

j)i<i<j are conditionally independent given Xm,mn by Lemma [TTJ (X*j) 1Ki< . are 
conditionally independent given Xm,mn since (Aj)i<j<j are independent from each other 
and Xmn,mn- Thus we only need to prove that for each i,j G N the random variables 
Xij and X*- are conditionally identically distributed given X MjMN . We prove this when 
i ^ j, the proof of the diagonal case is similar. 

Let r denote a permutation of N such that t({z , jo}) = {hj}- By relabeling (and 
using Xij = Xjj, X*j = Xjj) we might assume that r(i ) = t(i) and r(j ) = t(J) and 
that t = t' 1 . We extend r to M U N in such a way that \/k G M r(k) = k. 



(Xm, 


Mi Xifi 


Y Y* \ ^ 




(Xm, 


Mi Xi^ 


h Xj ; M, ^(^M,M, X it M, Xj^M, /3min(i,j),max(ij))) 




(Xm, 


Mi Xi Q: 


M) Xj 0> M, /i(Xm,Mi Xi Qi M., Xj 0t M, Pmin(i,j),max(i,3 


))) 


(Xm, 


Mi Xi 0} 


M i Xj 0j M, h (Xm,M, Xi t M , Xj t M , /3i ,j ) ) ^= 




(Xm, 


Mi Xi 0j 


y v * \ G3 




(Xm, 


Mi Xi Qi 


Mi A jo,M, X J / ~ 




{Xm, 


M, Xij, 


I) X^m, Xjj) 





As a consequence we get for all / G L°°(No) 

E (f(Xij) | Xm,mn) = E (f(X*j) | Xm,mn) 



50) 



with N = {i, j}. Now using Lemmas 161 fT2l and the fact that flmm(i,j),mioc(i,j) is independent 
form X MNjMN we get 



E (f(Xij) | Xfv 



E (f(Xij) | X MjMN , X M;MN 
(2D 



E (f(X it j) | Xfv 



JHol 



E (f(X*j) | X MjMN ) — E (f(X*j) | X MiMN , X MjMN ) — E (f(X*j) | X M)MN ) 
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which proves that X{j and X*j are conditionally identically distributed given X M MN . 

Having established ( I7^|) the next step is to code X it M for each i 6 N. By Lemma M 
OH} there exists g such that, putting X* M := (j(Xm,m, t^ ) we have 

For each i e N define 

-^i\M := P^M.Mj ^i) (81) 

Then 

since neither distribution depends on i. 
We now want to use Lemma [7] to prove 

(X m ,m, Xl m ) im ~ (X M ,M,^i,M) igN - (82) 

(^iV)ieN are conditionally independent given Xm,m by since (£/j) igN are independent 
from each other and X MNMN . (X i M ). gN are conditionally independent given X m ,m by 
Lemma EH thus flM}. 

Putting together (J77D, ([ZSD, dZHD,® and tfS2]) we see that (X M>M , X NjN ) ~ (X MM , X N)N ) 
where 

^ | ^(^M,M, <?P^M,M> ^i)j <?(^M,M) ^j), Anin(j,j),max(i,j)) if « 7^ j /g^x 

1 /i(Xm,Mj ^(-X"m,M) C^i), A,i) if * — J 

Finally, code Xm,m as a function of a using Lemma [S] © and the desired representation 
(1501) is established. □ 



4.3 Dissociated arrays 

Now we show how a special form (15"Tj) of the general representation (loT)|) correspond to 
the dissociated property (Definition [H]) of the vertex exchangeable array X^^. 

First we define various cx-algebras on the measurable space (A^,J-"). 

Let S n C T denote the cx-algebra generated by the events that are invariant under the 
relabeling of the first n nodes. So an J-"-measurable function g : A^t — > M is iS„-measurable 
iff it satisfies 

\/AeA N : g((A(i,j))? J=1 ) =g((A(T(i),T(j)))%=i) (§ 4 ) 

for every permutation r : N — > N satisfying r(n') = n' for every n' > n. Clearly 
Sn 5 $n+i- Define the a -algebra of symmetric events Soo by 

00 

Soo ■= fl Sn (85) 

n=l 
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Alternatively, a function g is iSoo-measurable iff ( 18~4"|) holds for any finitely supported 
permutation r. Define the cr-algebras 

T n := a {(A(i,j))l.^) G n := a [(A(i, j))^) (86) 

7i C 7 2 C . . . and C?i D t? 2 ^ The a-algebra of tail events Goo is defined by 

oo 

£00 := fl £n (87) 

n=l 

It is easy to see that Q n C5 n , which implies Goo C (S^. 

Theorem 3. T/ie following properties are equivalent for a vertex exchangeable array 

1. Soo is trivial, i.e. it contains only events with probability or 1. 

2. Goo is trivial, i.e. it contains only events with probability or 1. 

3. X N]N is dissociated. 

4- There exists a measurable function g : [0, l] 3 — > No such that 

g(ui,u 2 ,b) = g(u 2 ,ux,b) (88) 

and defining 

Xij = g(Ui, Uj, /3min(j,j),max(jj)) (89) 

we have X ~ X. 

The equivalence of [TJ and |3J is proved in [9], Proposition 3.6 using a different 
terminology (and proof): a consistent countable random graph model is local if and only 
if it is ergodic. 

Proof of U\ <^ H. 

In fact we prove that and Goo are essentially the same. This is a version of the 
Hewitt-Savage theorem ([TJ], page 382). The inclusion Goo ^ Soo is obvious. Conversely 
we show that any bounded iSoo-measurable random variable is essentially ^oo-measurable. 
It is enough to show that for any / G L? (An, <Soo, Px) we have 

E(/(X N)N )|0 oo ) = /(X N)N ) (90) 

Recall the definitions of the a-algebras T n and Gn in (1861) . In order to prove (l90i) it is 
enough to show that 

V£>0,Vm E((E(/(X N , N )|^ m )-/(X N , N )) 2 ) < e. (91) 
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Fix e > and m. It follows from ( 1571) and (I59p that there exists anneN such that 
defining N := [n] we have 

E ((E (/(X N)N ) | X NiN ) - /(X N , N )) 2 ) < e 

We might assume m < n. Thus by (|55p there is a function g : A n — > K such that 

E ((^(X NiN ) - /(X N>N )) 2 ) < e. 



Now take N C N, 



N 



|N| = n, N PI N = and a permutation r that swaps the 
elements of N with those of N. Since / is iSoo-measurable we have / fpQj)°^- =1 J = 
/ ^(X r (j) jr (j))°° =1 J. If we combine this with the vertex-exchangeability of Xn,n we get 

E((^(X^)-/(X N)N )) 2 ) <e. 

Now N C {m + 1, m + 2, . . . }, thus g(X^^) is ^-measurable, and by the conditional 
version of Steiner's inequality ( 1551) we get 



E ((E (/(X N>N ) | m ) - /(X NiN )) 2 ) < E (^(J^n) - f(X N:N )Yj < e. 
Thus (ED is established. □ 



Proof of \E <^ 

This proof is based on the proof of Theorem 5.5 in [5]. 

First we prove [2J =>■ El In order to prove that X N N is dissociated we only need to 
show that for all e > 0, for all finite subsets N,MCN such that M n N = and for all 
/ G L°°(Am,m) and g G L°°(.4n,n) we have 

\E(f(X M>M )g(X^)) -E(/(X Mj m))E(<7(X NiN ))| <e (92) 
We might assume ||<?||oo < 1- Since ^ is trivial, by ( 160]) there is an n G N such that 

E (|E (/(X m ,m) I Qn) - E (/(X m ,m))|) < £ (93) 



We might assume MUN C [n]. Let N C {n+l,n+2, . . . }, 
we have 



N 



| N | . By exchangeability 



E (f(X MM )g(X N ^)) - E (/(I m ,m)) E (<?(X n>n )) = 

E (/(Xm.mM^n)) - E (/(X m ,m)) E (^n)) = 

E ([E (f(X UM ) | ft ) - E (f(X MM ))} g(X m )) 

Now (JS2D follows from I^H^ < 1 and <$5§. 
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The proof of[3J ==>• is similar to that of Kolomorov's 0-1 law (jE)], Theorem 4.11): 
From the dissociated property of Px it follows that for all n G N the cx-algebras JF n and Q n 
are independent. From standard approximation arguments we get that T = a (U^Li J~ n ) 
and Qao = f)™ =1 Q n are also independent, thus is independent from itself, thus it can 
only contain events of probability or 1. □ 

Proof offl <^ 

This proof is based on the proof of Proposition 3.3 in pp. 
The proof of 01 ==>• [3j is trivial since an array X of form f )89|) is dissociated. 
As for the other direction: It is easy to see that the extended array -Xmn,mn is also 
dissociated from which the independence of X M;M and X N N follows. 

The construction in the proof of Theorem [2] (see (1531 ) gave an array -Xn,n of the form 

X^j = /(-Xm,M, Ui, Uj, /3 m in(i,j),max(i,j)) 

which was shown to satisfy (1m,M)^n,n) ~ (-^m,m> ^n,n)- But Xm,m and Xn,n are 
independent, thus the final step of the proof of Theorem [2] (coding Xm,m as a function 
of a) gives a representation (j50|) in which X^s is independent of a. Thus it holds for 
almost any a G [0, 1] that the random variables (f(a, U, Uj, /3 m in(jj),max(i,i)))J° =1 have the 
same distribution as Xpj,N- Defining 

g(ui,u 2 ,b) := f(a,u 1 ,u 2 ,b) 

for any such a gives the desired representation (1891) . 

□ 

5 Proof of Theorem H 

5.1 Proof of Theorem [D (a) =4> (6) 

The idea that Theorem [2] can be applied to prove (a) =>• (b) comes from [5] . 

If / G T, then by Lemma E] there exists a multigraph sequence (G n )^l 1 and a random 

array X such that X Gn — )■ X and P (Vz,j < : A(z, j) < X(i, j)) = f(A) holds. X Gn is 
vertex exchangeable and dissociated for all n so its limit X is also vertex exchangeable 
and dissociated. Thus by the [3j =>■ HJ implication of Theorem |3] we get that X ~ X 
where X is defined by f l89|) . Define the multigraphon W by 

W{x,y,k):= [ l[g(x,y,b) = k]db = P(g(x,y,P) = k) 
Jo 

where (3 ~ U[0, 1]. W is indeed a multigraphon: (fl6|) follows from ( 188|) . and (JTTJ) and (TT8|) 
follow from the fact that X is a random element of An (see (|29|) ). From ( 189|) . Definition 
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[6]and Lemma [7] it follows that Mt/j) ieN ,Xj ~ ((t/j) i6N , Xvp). Thus for any F G M. 
with adjacency matrix A we have 

f(A) = p(yi,j<k:A(i,j)<X(i,j] 



P (Vz, j < k : A(i,j) < X w (i,j)) I 1 t< (F, W) 

5.2 Proof of Theorem ID (6) (c) 

Suppose that there exists a multigraphon for which /( • ) = t< ( • , W 7 ). It is easy to 
check that the graph parameter t< ( • , W) is normalized, multiplicative and non-defective. 

In order to prove that / is reflection positive we only need to show that the connection 
matrices M(k, f) are positive semidefmite for each k > 0. Let us fix k. Suppose that the 
finite minor of M(k, f) is indexed by the /c-labeled multigraphs F\, F 2 , . . . , F^. We label 
the unlabeled vertices of F\, . . . ,Fn using disjoint subsets of N, so that the adjacency 
matrix A m G Av(F m ) and for all l,m G [N], i^mwe have V(Fi) fl V(F m ) = [k]. 

Recalling Definition [6] we define the random variables Yi, . . . , Yjy by 

Y m := 1 [Vz, j G V(F m ) : A m (z, j) < X w (i,j)\ . 

(M(k, /)) F m ) = f(FiF m ) = t< (FiF m , W) ^ t< (A, V A m , WQ I 1 

E(l[Vz,j G V(F,)uy(F ro ) : (A, V A m )(i,j) < X w (i, j))) = E (Y t ■ Y m ) 

The finite minors of M(k, f) are positive semidefmite because for any v : [N] — > K we 
have 

y T -M(fc, /)•*; = ^ E (Y, • K ro ) • f;f m = E j (j> m -r m ) J > 0. 

l,m=l V \m=l / / 

5.3 Proof of Theorem QJ (c) (d) 

The proof follows the main idea of [8]. We prove that if / is reflection positive then 

P > o. 

Let us fix k G N. Let F\ and F 2 be fc-labeled graphs with no unlabeled nodes (thus 
\V{F X )\ = \V{F 2 )\ = k). By (0} the adjacency matrix of F X F 2 is 

(A 1 V A 2 ) (i, j) = max (A^i, j), A 2 (i, j)) 

We introduce matrices whose rows and columns are indexed by adjacency matrices from 
A k . Define M,Z,De lR- 4fcX - 4fc by 



M{A 1 ,A 2 ) 
Z(A U A 2 ) 
D(A U A 2 ) 



f(A 1 VA 2 ) 
1 [A x < A 2 ] 
t[A 1 = A 2 }-f(A 1 ) 
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It follows from (c) that M is positive semidefinite since it is a symmetric minor of the 
connection matrix M(k, /). We show that M = ZDZ T : 

(ZDZ T ) (A, B) = Z ( A > E ) ■ D ( E > F ) ■ B ) 

E,FeA k 

= ]T 1 L4 < £] f*(E)l [B<E]=J2 f( E ) 

EeA k AvB<E 

= (/t)- f (A V B) ( = } f(A V B) = M(A, B) 

The equation (*) follows from the assumption /(oo) = and (jH]). 

In order to prove that /' > it suffices to show that Z is invertible because then 
the diagonal matrix D = Z~ 1 M (Z^ 1 ) is also positive semidefinite so f'(A) > for all 
A G Ak- It easily follows from ()7j) that the inverse matrix of Z is 

Z~\A U A 2 ) = (-1)^-^)1 [A 2 -A,e S k ] . 



5.4 Proof of Theorem [D (d) =4> (a) 

Assume given a normalized, multiplicative, non-defective multigraph parameter / with 
non-negatine Mobius transform. Our aim is to prove that / G T, that is f[25]) holds. Our 
proof is the multigraph analogue of Corollary 2.6 of [8], but we use reverse martingales 
instead of Azuma's inequality to prove (19"o")) . as suggested in [3]. 

First we define a probability measure P n on ^4 n . For every A G : P n (A) := /^(A). 
P n is indeed a probability measure since p > and using that / is non-defective, 
multiplicative and normalized we get 



£ f\A) = (py 1 (o n ) i /(oo = /(oo- = i. 



Next we show that ( 157)) holds, i.e. if (A n (i, j))™ J=1 has distribution P n and (X n+1 (i, j))""!^ 
has distribution P n+ i then (X n (i, j))" J - =1 ~ (X n+1 (z, /))™. =1 . We have to show that if we 
define g : A n — > R by 

0(A) := £ l[(A / )^ =1 = i4]./t( i4 0, (94) 
A'e.4„+i 

then VA G A / f (A) = We only need to check that VA G A* /(A) = _t (A), 

because 

The proof of the identity (*) is similar to that of Lemma [TJ 
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If A G A n then define A G A n+ i by 

a / • '\ ) A ihj) if hj<n 

Mhj) = < n ,. , 1 

I (J it max(2, j) = n + 1 

(i.e., we add an isolated vertex labeled by n + 1 to the labeled graph with adjacency 
matrix A). Using that / is non-defective, multiplicative and normalized we get 

g'\A) i 1 (/t)-t (A ) i f(A ) = /(A)/(0x) = /(A) 

So we have constructed a series of probability measures P„ which satisfy the consis- 
tency condition (1371) thus from the Kolmogorov extension theorem it follows that there 
exists a random infinite array X with distribution P such that 

VfceNVAeA P(A) = P (X| fe = A) , f(A) = P (X| fc > A) 

holds where X|^ := {X(i, ,- =1 . X is exchangeable because the value /^(A) is invariant 
under relabeling. Now we show that X is dissociated: by Definition [8] we only need 
to check that X|y x is independent of X|y 2 if Vi, V2 C N, \V\\ < +00, | V2 1 < +00 and 
VxflT^ = 0- Let A\ G Avt, A 2 G ^4y 2 and denote by F 1; F 2 the corresponding multigraphs. 
It follows from the multiplicativity of / that the events {X|y x > A{\ and {X|y 2 > A 2 } 
are independent: 

P ({X\ Vl > A,} n {X\y 2 > A 2 }) ® f{FiF 2 ) = 

f(F 1 )f(F 2 ) = P (X| Vl > Ai) P (X|y 2 > A 2 ) . 

Now for i = 1,2 the family of events I« := ({X|v 4 > ^4})^ £v 4 v is stable under finite 
intersection and cr(Xj) = (j(X|yJ by the inclusion-exclusion formula ([7]), thus X]^ and 
X|y 2 are independent by Lemma 4.2 of [T5] . 

We generate a (random) multigraph sequence G\,G 2 , ... by defining the adjacency 
matrix of G n to be X| n for all n. We claim that 

tl(F,G n )^f(F). (95) 

From (gSJ) and ([25]) it follows that lim t< (F, G n ) = f(F) almost surely, so / G T. 

To prove fl95l) for a particular multigraph F with adjacency matrix A G ^ recall 
the definition of the a-algebras S n and Soo (see (jSljl and fl85|) ) and Levy's 'Downward' 
Theorem fl60|) : 

E (1 L4 < X| fe ] I 5 n ) E (1 [A < X| fc ] I (96) 

In our case iSoo is the trivial cx-algebra by the [21 ==>■ [U implication of Theorem [31 
thus E (1 L4 < X| fc ] I 5oo) = P (A < X| fc ) = /(A). 
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So it is enough to show that for n > k we have E (1 [A < X|J | S n ) = t% (F, G n ) in 
order to prove (1951) . Recalling OH]) and (11 II) we have 

#<{F,G n ) = - — — r-TT E U[A,X\ n ,<p]- (97) 

n(n — 1) . . . (n — k + 1) 

It directly follows from the vertex exchangeability of X, (lolZl) and flMl) that for all 
99 : [A;] = — >• [n] we have 

E (1< [A,X\ n , ip\ 1 5 n ) = E (l<L4, X| n , id [fe] I <S n ) 

where idm is the identity map on [A;]. Thus 

E (1 [A < X\ k ] I S n ) = E (l<L4, X| n , id w I <S n ) 



1 



- ]T E(l<[i4,X| B ,¥»]|^) 



n(n — 1) . . . (n — k + 1) 

K ' V 7 <p:[fc]«->-[n.] 

The equality (*) is true since £< (F,G n ) is iS n -measurable by fl84|) . This concludes the 
proof. 

5.5 Tightness 

In this subsection we prove Proposition |2j We use the notion of tightness of a sequence 
of M -valued random variables (for the general definition see Section 5. of [3]): If Y n is 
an R -valued random variable for each neN then we say that (Y)^ =1 is tight if 

lim max P (m < I |Y n | |oo) = 0. 



m— >oo n 



In order to prove (jl]), assume given a convergent sequence (W n )^ =1 of multigraphons 
(see Definition ED- First note that the proof of Lemma [3] works without any change for 
multigraphons as well, so the sequence of random arrays (X^ n )^° =1 converges in distribu- 
tion (see Definition El (|4Tj) and (H2|) ). In particular, the sequences of No- valued random 
variables (Xw n (^, l))^Li and (Xvi/ n (l, 2))^1 1 converge in distribution, which implies (see 
Theorem 5.2 of [3]) that they are tight: 



lim max P (m < X Wn (l, 1)) = lim max P (m < X Wn (l, 2)) = (98) 

m— >oo n m— >oo n 

Now by Definition |6] we have 

P(m<X Wn (l,2))= / YVn^AOdzdi, (99) 

■ / ° ^ fc=m 
„1 00 

P(m<X W r„(l,l))= / E^ n (x,x,A;)da; (100) 
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from which (I26p and (j27p directly follow. 

Now we prove (jn]). Assume given a tight sequence of multigraphons (W n )™ =l . First 

we prove that for all k G N the sequence of ^-valued random variables {X Wn {i, - =l 
is tight: 



m— ¥00 n 



lim max P I m < max (Xw n (i,j)) = (101) 

i,j€[k] 



By (ESD, ((2ZD, dSSD and ( 1X00"]) we get ([98]). Using vertex exchangeability of X Wn we get 

P (m< m^(X Wn (iJ)) \ <k-P(m<X Wn (l,l))+r) ■ P (m < X Wn (l, 2)) 

which implies fllOip . Now by Prohorov's theorem ([3], Theorem 5.1) for each k the 
sequence (-X"w^(*) j))tj=i > (-^w 2 (h j))^ j=i > ■ ■ ■ nas a subsequence which converges in dis- 
tribution. By a diagonal argument one can choose a subsequence (w(m))^ =1 such that 

for all fc f XvK„ (TO) («,i) ) converges in distribution as m — > oo, thus — >■ X 

V n m / i,j=l n m 

for some random array X. By the multigraphon version of Lemma [3] the sequence of 
multigraphons (W / n ( m ))^_ 1 converges. 
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